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ABSTRACT 

The  sequential  nature  of  activities  like  research,  development,  or 
exploration  requires  optimal  funding  criteria  to  take  account  of  the  fact 
that  subsequent  funding  decisions  will  be  made  throughout  the  future.   Thus, 
there  is  a  continual  possibility  of  reviewing  a  project's  status,  based 
on  the  latest  information.   After  setting  up  a  model  to  capture  this 
feature,  optimal  funding  criteria  are  investigated.   In  an  important 
special  case,  an  explicit  formula  is  derived.   As  well  as  throwing  light 
upon  the  nature  of  development  activities,  the  analysis  is  also  relevant 
to  the  general  theory  of  information  gathering  processes. 


1.   INTRODUCTION 

Certain  economic  activities  have  such  special  features  that  the  usual 
"investment  criteria"  are  rendered  practically  irrelevant.   Examples  are 
research,  development  and  exploration.   A  real  need  exists  to  have  simple 
operational  funding  rules  for  such  processes  which  take  account  of  their 
sequential  nature.   The  present  paper  is  an  attempt  to  characterize  when  it 
is  optimal  to  fund  a  sequential  project. 

Our  point  of  departure  is  a  single  research,  development,  or  exploration 
project  which,  by  the  usual  partial  equilibrium  assumptions,  can  be  analyzed 
in  isolation  from  the  rest  of  the  economy.   In  the  course  of  undertaking 
such  a  project,  more  and  more  information  is  continually  being  revealed 
about  potential  benefits.   As  it  is  generally  possible  to  make  decisions 
like  backing  out  if  prospects  appear  unfavorable  in  a  pay-as-you-go  project, 
a  rational  decision  maker  will  wish  to  systematically  exploit  accumulated 
information. 

Throughout  this  paper,  it  will  be  convenient  to  work  with  a  mathematical 
abstraction,  idealization,  or  model  which  we  call  a  Sequential  Development 
Project  (SDP) .   This  concept  is  meant  to  embodv  some  essential  features  of 
research,  development,  or  exploration  processes:   costs  are  additive; 
benefits  are  received  only  at  the  termination  of  the  project;  there  is  always 
the  possibility  of  discontinuing  the  project  altogether. 

A  basic  assumption  which  will  be  made  is  that  we  can  describe  where  we 
are  in  a  SDP  by  an  index  called  its  stage  or  step.   As  the  SDP  moves  through 
its  various  stages,  more  costs  must  be  paid  out,  but  greater  information  is 
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amassed  because  more  outcomes  of  particular  stages  have  been  realized. 

Benefits  in  a  SDP  are  unknown  or  uncertain  at  each  step  and  are 
received  only  at  termination.   As  the  SDP  proceeds,  more  information  about 
benefits  is  accumulated  with  each  step.   Mathematically,  the  distribution 
of  final  benefits  shifts  as  results  turn  out  better  or  worse  than  anticipated 
and,  at  the  same  time,  the  distribution  narrows  because  less  uncertainty 
remains.   At  the  final  stage,  all  uncertainty  has  been  driven  out  and 
benefits  are  known. 

As  contrasted  with  benefits,  which  are  a  terminal  payout,  costs  in  a 
SDP  are  a  running  payment,  additive  across  stages.   The  cost  of  getting  from 
one  stage  to  the  next  is  typically  uncertain,  but  once  paid  it  is  a  sunk 
cost. 

In  a  SDP,  the  reasons  for  paying  running  costs  to  move  the  project  along 
depend  upon  the  form  of  the  research,  development,  or  exploration  that  is 
being  undertaken.   If  the  research,  say,  is  necessary  in  the  sense  that 
benefits  cannot  be  received  unless  the  research  is  completed,  then  there  is 
the  traditional  motive,  present  in  purely  deterministic  situations,  of 
bringing  the  project  closer  to  completion  so  that  benefits  can  be  realized. 
However,  in  an  uncertain  environment  there  is  the  additional  motive  of 
paying  running  costs  to  obtain  more  information  about  potential  benefits. 
This  may  be  desirable  even  if  the  benefits  per  se  are  unaffected  by  the 
research  activity.   For  instance,  in  oil  exploration  a  seismographic  test 
does  not  affect  the  net  benefit  that  would  be  received  by  constructing  an 
oil  rig  and  pumping  out  the  available  oil.   However,  such  a  test  may  give  a 
good  indication  of  whether  it  is  profitable  to  exploit  a  particular  field. 

In  what  follows,  we  will  find  it  useful  to  distinguish  between  two 
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types  of  SDP's.   In  the  first  (typical  R&D),  all  stages  of  the  project  must 
be  completed  before  benefits  can  be  received;  in  the  second  (mineral 
exploration,  marketing  a  new  product) ,  the  stages  of  development  are  optional 
in  the  sense  that  the  SDP  could  in  principle  be  terminated  at  any  stage  and 
the  benefits  received  —  however,  premature  termination  implies  the  resulting 
benefits  to  be  received  are  uncertain.   In  the  sequel,  the  second  type  of 
SDP  will  be  called  a  Two-Sided  SDP  (for  reasons  that  will  become  clear  later) . 
When  the  term  SDP  is  used,  henceforth  it  will  be  reserved  for  the  first  or 
one-sided  type  of  process. 

An  essential  feature  of  the  environment  that  we  are  trying  to  model  is 
the  possibility  of  continuously  reviewing  a  project's  status,  based  upon 
the  latest  information.   In  deciding  whether  to  continue  funding,  the  aim  is 
to  maximize  expected  benefits  minus  costs.   At  each  step,  an  optimal 
decision  rule  will  indicate  whether  to  continue  or  terminate,  based  on 
current  information.   With  the  Two  Sided  SDP  there  is  also  the  additional 
choice  at  termination  of  whether  to  receive  the  terminal  benefits  or  back 
out  of  the  project  completely. 

If  the  development  process  did  not  have  a  sequential  character  —  if 
the  possibility  of  continuous  review  was  eliminated  so  that  only  a  once-and- 
for-all  decision  might  be  made  as  to  whether  benefits  would  be  received  — 
then  the  optimal  decision  rule  would  be  simple.   For  a  SDP,  the  project 
should  be  undertaken  if  and  only  if  expected  terminal  benefits  exceed 
expected  costs  (to  completion) .   For  a  Two-Sided  SDP,  there  is  no  reason  to 
incur  research  costs  and  the  project  should  be  immediately  undertaken  if  and 
only  if  expected  terminal  benefits  are  positive.   With  sequential  decision 
making,  a  rational  policy  maker  is  given  more  freedom  and  it  is  not 
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Surprising  that  the  prospect  of  continuous  review  tends  to  make  a  project 
look  more  attractive.   It  is  important  to  understand  why. 

As  an  extreme  example,  suppose  there  is  some  stage  with  a  low  cost,  very 
high  variance  contribution  to  the  benefits.   For  example,  the  use  of  a 
seismographic  test  in  oil  exploration  mentioned  earlier  may  be  relatively 
inexpensive  to  perform  but  could  contribute  enormously  to  narrowing  down  the 
uncertainties.   Although  the  expected  net  benefits  from  the  exploitation  of 
the  well  might  be  negative,  the  optimal  policy  may  still  be  to  commission 
seismographic  tests,  and  then  build  a  rig' if  prospects  are  encouraging  or 
back  out  if  prospects  are  unpromising.   The  bias  toward  tentatively  going 
ahead  with  a  project  is  more  pronounced  as  the  variance  of  benefits  is 
greater  because  the  realization  of  a  stage  removes  more  uncertainty  and 
allows  a  better  informed  decision  to  be  made. 

We  require  a  sequential  decision  rule  which  indicates  whether  or  not  to 
continue  at  each  stage  as  a  function  of  the  information  then  available.   The 
optimal  stopping  rule  maximizes  expected  benefits  minus  costs ,  taking 
account  of  the  fact  that  at  all  future  stages  we  will  also  be  following  an 
optimal  stopping  rule.   In  the  general  case,  an  optimal  stopping  rule  will  be 
very  complicated.   It  will  depend  upon  such  things  as  the  underlying 
probabilistic  process,  past  history,  the  distribution  of  costs  and  benefits, 
the  stage  where  the  project  is  currently  located,  etc. 

Our  primary  aim  is  to  derive  a  simple  operational  criterion  for  funding 
a  SDP  or  a  Two-Sided  SDP.   Such  a  criterion  should  depend  in  a  straightforward 
way  on  basic  parameters  of  the  development  project  so  that  it  can  be  easily 
applied  and  analyzed.   Yet,  given  this  aim,  it  should  not  be  based  upon 
assumptions  or  regularity  conditions  that  are  unduly  restrictive. 
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We  concentrate  for  the  most  part  on  (One-Sided)  SDPs  where  benefits 
can  only  be  received  after  all  stages  have  been  completed.   In  section  2 
a  model  is  laid  out  and  the  optimal  decision  rule  is  presented.   Section  3 
is  concerned  with  the  properties  of  the  model  and  the  derivation  of  the 
optimality  criterion.   Sections  4  and  5  then  deal  with  a  relaxation  of  the 
assumptions  required  for  the  results  of  Sections  2  and  3.   The  Two-Sided  SDP 
is  considered  in  Section  6,  and  concluding  remarks  are  offered  in  Section  7. 

2.   A  Model  of  Sequential  Development 

We  suppose  that  the  SDP  must  pass  through  a  series  of  distinct  stages 
whose  order  is  considered  to  be  rigidly  prescribed  at  the  outset;  further, 
benefits  will  only  be  received  if  all  stages  of  the  project  are  completed. 
For  example,  in  an  R&D  project  the  first  stage  might  be  the  construction  of 
a  prototype  model,  followed  by  intensive  development  of  a  particular 
component,  then  development  of  another  component,  etc.   The  assumption  that 
a  sequential  development  project  can  be  well  ordered  by  its  stage  of 
development  is  a  mathematical  abstraction  that  allows  the  entire  decision 
structure  to  be  reduced  to  a  stop-or-go  problem  at  each  step.   The  only 
choice  is  between  terminating  or  continuing  on  to  the  next  step.   Thinking 
of  each  stage  as  fulfilling  some  particular  function  in  the  development 
process,  a  complete  temporal  ordering  does  not  seem  wholly  implausible. 

The  state  variable  is  the  number  of  steps  or  stages  from  the  end.   At 
stage  s  there  are  s  steps  remaining  to  be  completed  before  the  project  can 
be  implemented  and  benefits  collected.   Viewed  with  the  information  available 
at  stage  s,  the  final  benefit  is  a  random  variable,  denoted  X  .   As  s  becomes 
smaller,  more  information  is  available  and  X   is  made  progressively  less 
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uncertain  until,  at  s  =  0,  X   is  no  longer  random. 

Development  costs  for  each  stage  are  also  uncertain.   But  by  contrast 
with  benefits,  development  costs  are  pay-as-you-go  or  running  costs.   Once 
paid,  the  expenditure  of  realizing  a  stage  is  in  effect  a  sunk  cost.   If 
development  effort  ceases  before  the  project  ends,  no  benefit  is  received. 
If  development  continues  to  completion  through  all  s  remaining  project 
stages,  the  expected  extra  cost  is  C  . 

To  render  the  economic  analysis  of  a  SDP  tractible,  we  need  further 
assumptions.   We  must  postulate  the  specific  form  of  the  probability  density 
function  for  benefits,  as  well  as  the  exact  relationship  between  costs, 
stages  of  development,  and  the  spread  of  the  distribution  of  benefits. 
Lacking  such  regularity  assumptions,  we  would  be  faced  with  a  very  general 
process  and  it  would  be  extremely  difficult  to  obtain  a  strong  characteriza- 
tion of  the  optimal  stopping  rule.   In  Sections  4  and  5  we  will  discuss  what 
happens  in  more  general  cases  or  with  different  conditions. 

There  are  three  basic  regularity  assumptions. 

1:   The  random  variable  X  ,  representing  terminal  benefits 
as  perceived  at  stage  s,  is  normally  distributed  for 
each  s. 

Of  all  the  specific  families  of  distributions  to  assume,  the  normal  is 

perhaps  the  least  objectionable  in  a  context  like  this.   Section  5  will  show 

how  the  normality  postulate  can  be  derived  from  a  few  simple  assumptions. 

Suppose  at  stage  s,  X  has  a  standard  deviation  a     and  at  stage  t, 

s  s 

t<s,  X,_  has  a  standard  deviation  n   <  a    .   Then,  viewed  from  stage  s: 
t  t    s         
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a)   the  mean  of  X   is  known,  say  \i    ,  and 
s  s 


X  *   N(u  ,a  2)  ,  (1) 

s      s  s 


b)   X,.  ^  N(m.,a  .2)   where  m  ^   N(u  ,a  2  -  a2) 
t      t  t  t      s  s     t 


Statement  (b)  is  true  because,  in  order  for  information  to  be 

consistent,  (X  -  p  ) ,  which  is  N(0,a  2)  ,  must  be  distributed  as  (X.  -  m  ) , 
s    s  s  t    t 

which  is  N(0,a .  ),  plus  (m  -  u    ) .   It  follows  from  the  way  independent 

normal  distributions  add  that  (iti  -  u  )  must  be  N(0,a  2  -  a  2)  . 

t    s  st 

Thus,  as  the  project  moves  forward,  the  estimate  of  terminal  benefits 

contracts  in  variance,  while  its  mean  changes  consistent  with  the  assumption 

2 
of  normality.    The  decision  whether  or  not  to  continue  at  any  stage  will 

depend  upon  (among  other  things)  the  expected  benefit  viewed  at  that  stage, 

which  is  changing  stochastically  as  development  proceeds. 

Note  that  X  can  be  negative  with  non-zero  probability,  e.g.  the  net 
terminal  benefit  of  doing  R&D  on  an  alternative  technology  could  in  principle 
be  less  than  zero  if  the  value  or  cost  reduction  of  the  new  technology 
turned  out  to  be  less  than  that  of  an  existing  substitute.   The  best  way 
to  think  of  X   is  what  would  be  obtained  if_  the  project  were  forced  through 
all  the  way  to  completion  from  stage  s  (leaving  out  development  running 
costs).   In  principle,  a  negative  net  benefit  would  never  be  realized  or 
observed  because  the  project  could  be  stopped  before  its  end. 

As  the  SDP  passes  through  stages,  the  standard  error  of  the  distribution 
of  terminal  benefits  is  narrowing  down.   To  obtain  neat  results,  we  must 
postulate  that  this  is  occurring  in  a  regular  way: 
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2a:   For  any  stages  s  and  t 


a  C 


The  standard  deviation  of  estimated  terminal  benefits  at  any  stage  is 
assumed  proportional  to  the  expected  cost  of  carrying  the  project  through 
to  completion  from  that  stage.   Assumption  2a  means  that  if  the  project  is 
developed  to  a  stage  where  expected  remaining  costs  are  half  as  large,  the 
standard  deviation  of  estimated  benefits  is  also  halved.   This  is  a  specific 
way  of  quantifying  the  notion  that  the  spread  of  benefits  becomes  narrower 
as  development  proceeds.   It  is  a  very  powerful  aid  in  obtaining  neat 
results  and  does  not  appear  to  be  grossly  objectionable,  perhaps  because 

so  little  is  known  about  how  uncertainty  is  reduced  in  most  research, 

3 
development,  or  exploration  projects.   The  fact  that  assumption  2a  permits 

us  to  sharply  characterize  an  optimal  solution  makes  it  a  natural  preliminary 

to  any  more  general  analysis.   And  it  may  even  be  a  reasonable  description 

of  some  situations. 

In  Section  4,  a  more  general  process  will  be  considered: 

2b:  a     =  k(C  )Y,     k,y>0  f3) 

s      s 

Such  a  formulation  embodies  hypothesis  2a  when  y=l  as  well  as  the  hypotheses 
Y>1  (the  standard  deviations  falls  faster  than  expected  costs  to  completion) 
and  y<1  (the  standard  deviation  falls  slower  than  expected  costs  to 
completion) .  Actually,  in  Section  5  it  will  be  shown  that  a  much  weaker 
assumption  than  even  2b  has  strong  implications: 

2c:  a     =  h(C  )  for  some  well-defined,  continuously  differen- 

S         5         '   '  — ■  ~  ■ —   ■■■-■'■'■■      w*  ■  .i  -—-■■■  . 

tiable,  monotonically  increasing  function  h  satisfying 
0  =  h(0). 


-9- 


The  main  content  of  this  assumption  is  that  a   is  systematically  related  to 
C  .   We  shall  have  nothing  to  say  about  situations  where  2c  does  not  hold. 

Now  that  the  underlying  probabilistic  process  is  well  specified,  it  is 
easy  to  state  the  problem,  at  least  informally  (a  rigorous  statement  is 
temporarily  deferred) .   At  any  stage  the  relevant  issue  is  whether  to 
proceed  to  the  next  stage  or  terminate.   An  optimal  stopping  rule  is  defined 
by  backwards  recursion.   At  each  stage  an  optimal  stopping  rule  maximizes 
expected  benefits  minus  costs  based  upon  information  available  at  that  stage 
and  taking  account  of  the  fact  that  an  optimal  stopping  rule  will  be  used 
for  all  stages  hence,  based  on  the  information  available  at  those  later 
stages. 

A  final  regularity  assumption  is  needed  to  simplify  the  analysis.   So 
far  we  have  been  treating  steps  as  if  they  were  discrete.   Now  let  each  step 
size  become  smaller  and  smaller  until  in  the  limit  s  is  a  continuous  variable. 
This  embodies  the  notion  that  project  review  is  a  continuous  undertaking.   A 
stop-go  decision  can  be  made  at  any  point  because  each  stage  is  presumed 
infinitesimally  small  relative  to  total  project  size. 

3:   The  stage  of  development,  s,  is  a  continuous  state 
variable. 

The  following  theorem  holds  under  the  assumptions  that  have  been  laid 
down. 

The  Optimal  Stopping  Rule 

At  any  stage,  let  the  expected  cost  to  completion  of  the  project  be  C 
and  the  perceived  benefit  be  distributed  N(y,a2). 

It  is  optimal  to  proceed  with  the  SDP  if  and  only  if 

C  <  E  [Y|Y2  y]  (4) 
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where  Y  ^   N(0,o2) . 

The  righthand  side  of  (4)  is  simple  to  calculate; 


/  y  f(y)    dy 

E[Y|Y>y] 

1  f(y)    dy 

p 

a   exp(-y2/2a2) 

(5) 


/27  (l-$(p/a)) 


(6) 


where 


1     -v2/2a2 
f  (y)  =  e  Y  /za  (7) 

/2ira2 

1     X   -2/2 

$(x)  =  f  e     '    dz.  (8) 

/2T   — 

Perhaps  the  easiest  way  of  understanding  (4)  is  to  ask:   given  C  and  a, 
what  is  the  cutoff  value  of  p,  call  it  y,  which  turns  the  inequality  (3) 
into  an  equality?  This  is  defined  by 

c  =  e[y|y^m].  (9) 

At  p  =  y,  the  decision  maker  would  be  just  indifferent  between 
continuing  and  stopping  the  project.   When  y<u,  it  is  best  to  stop,  whereas 
if  p>p,  the  optimal  policy  is  to  continue  funding. 

Using  (5) ,  p  must  obey 


f    (y-C)f(y)dy  =  0  (10) 

P 
or, 

/  (y-C)f(y)dy=  /  (C-y)f(y)dy.  (11) 

C  p 
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Equation  (11)  allows  a  simple  geometric  interpretation  of  (9) ,  because 
the  N(0,a  )  probability  weighted  average  distance  from  C  to  °°  must  equal  the 
weighted  average  distance  from  C  to  p.   This  is  a  great  help  in  visualizing 
the  dependence  of  p  on  C  and  a,  even  if  it  provides  insufficient  explanation 
of  the  optimal  rule.   Although  equations  like  (10)  or  (11)  are  suggestive, 
the  underlying  process  is  complicated  and  the  real  justification  for  the 
theorem  is  its  proof. 

It  is  very  easy  to  determine  the  basic  properties  of  the  cutoff  benefit  pi 
i)   C>0  and  a>0   implies  that  y<C. 
ii)  a-*-0   implies  that  p-*C. 
iii)   a-x»  implies  that  pi-*-°°. 
iv)   C-K3  implies  that  u->—  °°. 
v)   C-*30  implies  that  pi-*40. 

Performing  comparative  statics  on  (10)  or  (11),  as  o  increases,  y 
decreases.   With  greater  uncertainty  in  benefits,  the  decision  maker  should 
be  willing  to  tolerate  a  lower  mean  when  deciding  to  continue  funding.   If 
a  is  larger,  it  may  be  optimal  to  check  out  a  few  more  stages  for 
superoptimistic  outcomes  even  though  pi  is  low. 

As  C  increases,  so  does  pi.   The  rationale  behind  this  is  obvious. 

Note  that  there  is  nothing  in  principle  to  prevent  u<0.   When  y<y<0,  it 
is  optimal  to  proceed  even  though  the  expected  value  of  terminal  benefits  is 
less  than  zero  (and  this  does  not  take  account  of  running  costs!).   Less 
than  zero  benefits  would,  of  course,  never  be  realized  because  the  process 
would  be  discontinued  before  completion.   From  (4)  and  (6)  ,  pi  —  0  as 


m<.u: 


C  " 
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3.   Micro-Aspects  of  the  SDP 

Although  the  model  we  have  outlined  is  well-specified,  its  form  is 
inappropriate  for  rigorous  analysis.   In  this  section,  a  mathematical 
formulation  is  presented  which  is  equivalent  to  our  original  model. 

We  have  already  established  that,  at  any  given  stage,  the  mean  of  the 
distribution  of  terminal  benefits  is  known  with  certainty,  but  is  a  random 
variable  when  viewed  from  an  earlier  stage.   In  other  words,  the  mean  of 
terminal  benefits,  p,  may  be  treated  as  undergoing  stochastic  shocks.   Given 
C  and  a  as  functions  of  the  number  of  stages  to  completion  of  the  process , 
all  relevant  information  is  summarized  in  the  number  of  stages  left  to 
completion,  s,  and  the  mean  of  the  (normal)  distribution  of  terminal  benefits, 

V 

Figure  1  shows  one  possible  realization  of  the  SDP. 

As  more  stages  are  completed  (we  move  to  the  right)  ,  the  mean  p 
changes.   At  s=0,  the  distribution  of  benefits  has  collapsed  to  u  ,  the  actual 
reward  made  possible  by  the  research,  development,  or  exploration. 

Figure  1  gives  an  example  where  the  SDP  is  pushed  through  to  completion. 
However,  our  major  interest  is  in  rules  which  tell  us  whether,  at  any  stage, 
the  project  should  be  terminated.   Such  a  decision  will  depend  upon  available 
information,  i.e.  (given  the  functions  C(s)  and  o(s))  the  pair  {p  ,s}.   Two 
properties  of  the  stop-go  decision  may  be  immediately  cited: 

1)  If  {p  ,s}  is  such  that  p  >C  ,  then  the  project  should  be  continued. 

To  see  this,  it  may  be  noted  that  p  -C  >0  is  the  expected  return  if 

s  s 

the  sub-optimal  rule  of  always  continuing  the  project  is  followed, 
whereas  if  the  project  is  terminated,  the  return  is  zero. 

2)  If  {p  ,s}  is  such  that  it  is  optimal  to  continue  with  the  project, 
then  it  is  optimal  to  continue  under  {p,s},  p>  p  .  This  follows 
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because  one  could  'pretend'  that  expected  benefits  were  y  ,  follow 

s 

the  optimal  rule  as  though  starting  from  y  »  and  then  take  the 
extra  benefit  y  -  y   if  the  project  were  to  be  completed.   From  our 
normality  assumption,  the  distribution  of  y   -  y  ,  t  <  s,  given  y  , 
is  independent  of  y  ,  so  that  increments  in  the  stochastic  process 
are  state  independent. 


From  these  properties  it  may  be  inferred  that  for  all  s  there  exists 

a  y(s)  (possibly  -<*>)    with  the  property  that  the  project  should  be  continued 

if  y  >y(s)  and  discontinued  if  y   <  y(s).    Our  task  is  to  derive  the 
S  s 

optimal  stopping  function  y(s). 

Given  a  stopping  function,  y(s),  it  is  theoretically  possible  to 
calculate  the  expected  net  value  of  the  project  starting  at  any  {y  ,s}.   Let 
V(y  ,s)  be  the  state  valuation  function  which  gives  the  value  of  the  project 
when  an  optimal  stopping  rule  is  followed.   V  can  never  be  strictly  negative 
because  a  policy  of  direct  termination  ensures  a  net  value  of  zero. 

From  the  definition  of  y(s), 


V(p(s),s)  =0  V  s  (12) 

Further,  at  s  =  0  all  uncertainty  has  been  removed  and  V  is  given  by 

V(y,0)  =  max(y,0)  (13) 

Now  let  us  look  at  the  stochastic  process  governing  y  .   First,  as  it 
is  being  assumed  that  there  is  a  continuum  of  stages  of  development,  any 
reasonable  normalization  concerning  s  can  be  adopted.   For  convenience, 
define  the  distance  s  to  the  end  of  the  project  by  the  fact  that  expected 
running  costs  to  the  end  of  the  project  are  proportional  to  s,  i.e., 
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C  =  s  c   for  some  constant  c.  (14) 

s 

This  is  an  admissible  normalization  if  C   is  declining  and  positive,  e.g. 

running  costs  at  each  stage  are  positive.   As  we  are  assuming  that  a   is 

s 

proportional  to  C  ,  the  normalization  imposes  the  constraint  that 

a     =  so   for  some  constant  a.  (15) 

s 

Thus  the  underlying  parameters  of  the  system  will  be  given  by  c"  and  a", 
and  the  state  valuation  function  V  will  be  dependent  upon  these  parameters: 


V  =  V(p,s;  c,  a)  (16) 

Of  course,  c~  is  subject  to  choice  by  a  normalization  of  the  number  of  stages 
to  completion:   if  the  process  has  s  stages  to  go  to  completion  when  the 
underlying  parameters  are  c  and  a  then  this  is  equivalent  to  there  being 
s/A  stages  left  when  the  underlying  parameters  are  Ac"  and  Ao".   Thus, 

V(u,s;  c,"a)  =  V(u,s/A;  Ac",Aa)  \J   A  >  0.  (17) 

Although  development  is  being  considered  as  a  continuous  process,  it  is 
useful  to  visualize  the  SDP  as  passing  through  discrete  stages  and  then 
taking  limits.   Assume  that  each  stage  is  of  length  %.      From  stage  s  to 
stage  s-£,  the  results  of  development  will  either  be  encouraging  or 
discouraging.   Encouraging  results  lead  to  an  upward  revision  of  u.   Assume 
that  the  change  in  p,  <5u,  is  given  by 

<5y  =  Za/2sT  (18) 

s 

where     e[z]  =  0,  Var  [z]  =  1. 
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The  random  variable  Z  gives  the  distribution  of  increments;  for  instance,  Z 
may  take  on  the  values  1  and  -1,  each  with  probability  h,    and  this  corresponds 
to  the  notion  that  each  stage  of  the  development  process  is  either  a  success 
or  a  failure.   The  mean  of  the  incremental  change  is  zero  because  any  bias 
will  have  been  predicted  and,  therefore,  is  already  embodied  in  u  . 

The  rationale  for  (18)  is  that  it  yields  (15)  .   The  variance  of  terminal 
benefits  at  distance  s  from  completion  will  be  equal  to  the  sum  of  the 
variances  of  increments  which  occur  before  completion.   As  at  time  s  there 
will  still  be  s/l   stages  to  completion,  (18)  gives 


Var  [x  ]  =  E 
s 


s/H 

T=l 


r      s/£  i 

=  E  [_2Z2  a2!.2      Z      tJ 
t=1 

=a2(s2  +  si)  (19) 

Thus,  as  l   tends  to  zero, 

CT  2  .  ^2S2  (20) 

s 

or, 

a     =  as  (21) 

s 

which  is  exactly  (15) .   Further,  as  X  is  constructed  from  a  large  number 
of  independent  increments,  the  Central  Limit  Theorem  gives 

X  ^  N(y  ,0  2) ,  (22) 

s      s  s 

so  that,  when  I   tends  to  zero,  (18)  is  compatible  with  the  assumptions  laid 
down  in  the  last  section.   In  actuality,  as  £  tends  to  zero  (18)  becomes  a 
stochastic  differential  equation  (see  Cox  and  Miller  (1965)): 
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dy   =  Z  a/2sds  C23) 

s 

We  have  seen  how  the  SDP  may  be  viewed  as  the  limit  of  an  additive 
process.   Under  the  normality  postulate  and  (15) ,  we  may  note  that  (23)  must 
hold.   For, 

u   -  y  ^  N(0,  s2?2  -  t2o2) 
t    s 

which  implies  that 

(u.  -  y  )2  =  Z2  ^(s2-  t2) 
t    s 

=  Z2  "o^s  +  t)  (s  -  t) 

wh-re  e[z]  =  0,  Var  [z]  =  1.   Letting  t  =  s  -  6s: 

(y   -  ]i       .    )2  =  Z2  ^Us  -  6s)6s, 
s    s-os 

so  that,  if  6s  ■+  0: 

dy2  =  Z2  a2  2sds, 
i.e.,  dy  =  Z  a/isds 

which  is  (23) . 

Our  primary  reason  for  working  with  continuous  rather  than  discrete 
stochastic  processes  is  just  that  it  enormously  simplifies  the  solution  of 
the  dynamic  programming  problem. 

We  are  now  in  a  position  to  investigate  tne  form  of  the  state  valuation 

function  V.   Consider  y   >  y(s).   Given  the  stochastic  specification  of 

s 

y,  in  a  sufficiently  small  time  interval  y  will  not  become  less  than  the 
stopping  value  y  with  probability  approaching  unity.    Thus,  within  a  small 
time  interval,  the  stopping  rule  can  be  ignored.   In  such  a  situation,  V(y,s) 
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is  the  expected  value  of  V(y  +  d  y,  s-ds)  after  the  payment  of  a  running  cost 
with  an  expected  value  c  ds : 

V(y,s)  =  E  [v(y  +  ZaV2sds  ,  s  -  ds)]  -  c  ds  (24) 

Taking  a  Taylor  expansion  of  (24)  (which  is  legitimate  as  ds  is  an 
infinitesimal)  gives  the  usual  Kolmogorov  type  diffusion  equation: 

V  o^s  -  V  -  c  =  0,  (25) 
yu      s 

where  subscripts  denote  partial  derivatives. 

Now  consider  the  form  of  V  when  y  =  y(s).   If  y(s)  is  continuous,  when 
the  realization  of  Z  is  negative,  V  will  be  zero  at  s-ds.   Thus, 

V(y(s),  s)  =  E[v(y  +  Zo"/2sds,  s-ds)  |z  -  o]«Pr[z  -  o]  -  c  ds 

(26) 
which,  when  evaluated  as  a  Taylor  series,  yields 

V  (y(s),  s)  =  0  (27) 

Equations  (12),  (13),  (25)  and  (27)  should,  in  principle,  completely 

characterize  the  form  of  the  function  V. 

However,  we  have  yet  to  exploit  the  fact  that  a  is  proportional  to  C  , 

s  s 

i.e.,  equation  (17).   First,  as  V  is  an  expected  monetary  value,  it  must  be 
measured  in  the  same  units  as  y,  c,  and  a".   V  must  therefore  satisfy 

V(y,s;  c,  a")  =  A  V(y/X,  s;  c/A ,  a/A)  MX    >   0.  (28) 

Combining  (17)  and  (28)  gives 

V(y,s;c,a)  =  X   V(y/A,  s/A;  c,a)    VA  >  0,  (29) 
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i.e.,  V  is  linearly  homogeneous  in  u  and  s.   Thus,  for  fixed  c  and  a,  V  can 
be  written  in  the  functional  form 

V(y,s)  =  y  g(y/s)  (30) 

Now,  (12) ,  (13) ,  (25)  and  (27)  become 

g(y(s)/s)  =  0  (12') 

g(»)  =  1  (13') 

a2   x  g"  (x)  +  (2a2  +  x2)  g'  (x)  -  c  =  0  (25') 

g' (y(s)/s)  =  0  (27') 

The  form  of  the  optimal  stopping  function  is  easy  to  analyze.   As  the 

state  evaluation  function  is  linearly  homogeneous,  it  must  be  the  case  that 

\i(s)  =  as  Vs  (31) 
for  some  slope  parameter  a.   (12')  and  (13')  become 

g(ot)  =  g'(cx)  =  0  .  (32) 
Solving  (25')  gives 


g'  (x)  =  —j        -k  exp  ( —  )  +  c 

x   L       ^  2a2y     J 


(33) 


where  k>0  is  a  constant  of  integration.   Using  (32)  to  eliminate  k  gives 

g-(x)  =  Jr  [l  -  exp  (^^J\  (34) 

The  differential  equation  (25')  holds  when  the  project  is  still 
continuing,  i.e.,  when  x  £  a.  Therefore,  it  is  permissible  to  write 
(using  (13')  and  (32)) 
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1  =  g(»)  -  g(a)  .  /  g' (X)  dx  (35) 

a 

(which  implicitly  defines  a) .   Integrating  (34)  by  parts  gives 


g(-)  -  g(x)  =|[i  -exp^^iJJ 


0  x 


+  ~  exp  (aVZcf2)  /  exp(-v2/2a2)  dv.  (36) 

Using  (35)  :. 


1  =  ==■  exp(az/2a2)  /  exp(-x2/25^)  dx.  (37) 

O2  a 

However, 


/  x  exp(-x2/2a2)dx   =  a2  exp(-a2/2a2) ,  (38) 

a 

so  that    (37)    can  be  written  in  the   form 


/MU2     I  exp(-xV2a2)    dx 


(39) 


Making  use  of  the  formula  for  the  normal  distribution,  this  becomes 

C  =  E[w|w  i  a]  C401 

where     W  ^  N  (0,  "a2)  . 

Condition  (40)  defines  the  slope  a  of  the  optimal  stopping  function.   If 

u  /s  >  a,  then  the  project  should  be  contined.   Using  (14)  and  (15)  to 
s 

eliminate  s,  which  has  been  used  only  as  a  carrier  variable,  the  project 
should  be  continued  if 


c  <  e[y|y  >  vi  ]  C41) 

s  s 
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where     Y  ^  N  (0,o  z) 

s 

This  is  precisely  the  stopping  rule  presented  in  the  last  section. 

Basic  properties  of  the  stopping  rule  have  already  been  considered  and 
will  not  be  reiterated  here.   However,  one  feature  of  the  rule  may  be  noted. 
Since  accumulated  information  is  not  useful  for  determining  future  running 

costs,  the  fact  that  they  are  uncertain  has  no  influence  upon  the  decision 

6 
maker.   As  soon  as  running  costs  are  expended,  they  become  a  sunk  cost. 

Thus,  there  is  a  fundamental  asymmetry  in  the  SDP  between  running  cost 

uncertainty  and  terminal  benefit  uncertainty. 

Having  obtained  the  optimal  stopping  rule,  now  let  us  investigate  the 

form  of  the  state  valuation  function  V.   Inserting  (37) ,  (38) ,  and  (39) 

into  (36)  yields,  after  some  manipulations, 


V(u,s)  =  yg(y/s)  =  u-Cg  +  j| 


{H&jy  [*|T  »  u]  -  „]      (42, 


where     Y  ^  N  (0,  a  2) 

s 

and  y(s)  is  the  stopping  value  of  y  at  s. 

Turning  to  an  analysis  of  (42) ,  we  have  already  stressed  that  there 

exists  the  possibility  of  utilizing  accumulated  information  during  the 

course  of  a  SDP.   If  such  information  could  not  be  utilized  then  the  expected 

net  benefit  of  the  process  would  be  given  by 

V(y,s)  =  y  -  C  ,   y  >  C  (43) 

s        s 

Thus,  for  y  >C  ,  the  value  of  being  able  to  utilize  accumulated  information 
is  given  by  the  last  term  in  (42) ,  i.e. 
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I-     -Pr 

Pr 


f^rMr  [E  [t|t  *„]-„]. 


and  (42)  can  be  rewritten  as 

V(y,s)  =  V(y,s)  +  I 

I  is  strictly  positive  if  and  only  if  the  variance  a   2  is  strictly  positive, 

Of  course,  information  will  only  have  value  if  it  is  likely  to  be  utilized. 

It  can  be  shown  that  I—  =   V—  >  0.   A  situation  with  higher  variance  has 

a  a 

greater  value  of  information. 

It  is  not  surprising  that  I  diminishes  with  y  (but  not  at  a  rate 
sufficient  to  diminish  V) : 

■1SI-.  pP?vf>  V>\  <   °  <45) 

y      Pr  {Y  >  y (s) } 

Notice  also  that 


I   >  0  (46) 

W 

so  that  V  is  a  convex  function  of  y.   The  common  sense  of  this  result  is  that 
an  increase  in  y  has  more  value  the  greater  the  probability  of  completion  of 
the  development  process.   This  probability  increases  as  y  increases,  since  it 
is  then  less  likely  that  the  stopping  rule  will  ever  be  invoked. 

To  further  understand  the  function  V,  it  is  useful  to  look  at  V  .   If 

s 

V  is  positive  then  a  decision  maker  would  like  to  undettake  more  "roundabout" 
development  processes  (bigger  s) .   This  increases  the  uncertainty  concerning 
terminal  benefits,  and  also  makes  total  running  costs  greater.   In  terms  of 
the  function  g, 


*s--(l 


s2 

)  g' (y/s)  (47) 
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so  that  the  sign  of  V  depends  upon  the  sign  of  g'  (the  sign  of  V  is 
independent  of  the  particular  normalization  of  s  which  is  adopted).   From  (3-1 


V  -  0  iff   p/s 
s  > 


(48) 


As  p/s  -   a  (V  only  takes  the  form  in  (42)  when  \i   >  as)  ,  V   >  0  if  a  <  0  and 


p/s 


These  conditions  hold  if  the  variance  of  the  process  is 


large  enough  (a  <  0  iff  C   <  a   \|—  )  and  if  the  realization  of  the  process 
is  sufficiently  close  to  the  stopping  line.   In  this  case,  the  value  of  being 
able  to  exploit  accumulated  information  is  so  great  that  there  would  be  a 
gain  from  adopting  a  more  roundabout  development  process  even  though  higher 
expected  costs  to  completion  would  be  involved. 

Figures  2  and  3  give  the  form  of  iso-V  curves  for  the  two  cases  a  >  0 
and  a  <  0. 

Two  interesting  features  of  these  regimes  may  be  noted.  First,  the 
slope  of  the  iso-V  curves  becomes  c"  at  s  =  0.  This  is  because  when  s  is 
close  to  zero,  the  probability  of  non- completion  is  so  small  that  it  may 
be  ignored. 

Second,  when  the  process  is  close  to  the  stopping  line,  the  use  of 
information  is  very  important.   If  the  variance  is  small  relative  to  costs, 
so  that  a  >  0,  the  process  will  be  continued  so  long  as  "average"  outcomes 
arise,  i.e.  p   stays  constant.   However,  when  a   <   0,  the  process  will  be 

continued  only  if  "successful"  outcomes  arise,  i.e.,  y   rises.   When  the 

s 

variance  is  large  relative  to  costs,  it  may  be  optimal  to  continue  with  a 
process  that  is  unlikely  to  be  completed  in  the  hope  that  future  stages  of 
development  will  be  more  successful  than  is  anticipated  a  priori. 
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4.   Non-Homogeneous  SDPs 

In  view  of  the  above  analysis,  it  is  appropriate  to  call  the  process 
where  a   is  proportional  to  C   a  homogeneous  SDP.   We  now  wish  to  consider 
the  characteristics  of  more  general  processes.   A  natural  class  to  investigate 
is  obtained  by  relaxing  assumption  2a  of  section  2  to  assumption  2b,  i.e., 
to  the  class  of  processes  for  which 

0e  =  k(C  )Y  (3) 

s      s 

for  some  k,  y   >   0.   To  take  an  example,  the  development  of  a  new  aircraft 

involves  wind-tunnel  tests  on  small  models.   Such  tests  are  likely  to 

significantly  reduce  a     with  little  reduction  in  C  .   In  this  case,  y   will 

s  s 

exceed  unity. 

A  different  pattern  emerges  if  each  stage  of  the  micro  development 
process  is  identical  to  any  other.   Assume  that  expected  running  costs  per 
stage  of  development  are  c"  and  that  the  stochastic  differential  equation 

governing  y  is  given  by 

s 

dp  =  Z  o  /is"  (49) 

where  E  [z]  =  0,  Var  [z]  =  1. 

The  importance  of  (49)  is  that  dy  is  independent  of  s.   Thus,  (49)  will 

be  recognized  as  a  Wiener  process  with  zero  drift.   The  macro-characteristics 

of  the  process  are  easily  analyzed. 

s 
C  =  f   c  ds  =  cs,  (50) 

s    o 

and 

a   2  =  E  7  Z2o2  ds  =  o^s.  (51) 


s 

Z2o2 

ds 

o 
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Thus, 


a 
a  =  a  /  s  = 


%     ^l  (52) 

vc  s 


so  that  the  process  belongs  to  the  class  given  by  (3)  with  y   =  h- 

In  fact,  y  =  's  is  a  natural  lower  bound  in  many  circumstances.   If 
development  takes  the  form  of  passing  through  a  large  number  of  independent 
stages,  then  y  <  ^  implies  that  stages  with  highest  variance  per  unit 
expected  running  cost  occur  at  the  end  of  the  project.   However,  should  the 
order  of  stages  be  subject  to  choice,  stages  with  the  highest  variance  per 
unit  running  cost  will  be  completed  first.   For  it  is  optimal  to  try  to  know 
whether  the  project  should  be  completed  after  the  smallest  possible  outlay 
of  running  costs.   This  is  achieved  by  first  undertaking  those  stages  of 
development  which  give  the  most  information  per  unit  expected  running  cost. 

The  determination  of  an  explicit  formula  for  p(s)  seems  to  be  a 
difficult  task  when  y   ?   1.   For  this  reason,  only  the  general  shape  of  the 
stopping  curve  will  be  investigated.   Not  surprisingly,  the  homogeneous  case 
where  y   =  1  turns  out  to  be  a  dividing  line  between  two  qualitatively 
different  regimes. 

As  in  the  last  section,  s  may  be  normalized  so  that 


C  =  s  c  (53) 

s 

In  this  case 

as  =  (kcY]  sY  (54) 

We  start  with  two  simple  properties  of  the  optimal  stopping  curve  y (s) 
First,  y(0)  =  0.   Second,  p(s)  £  c"s  as,  when  u  >  cfs  =  C  ,  a  policy  of 
always  completing  the  project  yields  positive  expected  net  gain. 
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Now  assume  that  the  development  process  has  reached  a  point  {y,  s} .   It 
is  clear  that  \i   >   vi(s)  if  a  positive  expected  net  gain  would  result  from  a 
policy  of  pushing  the  project  through  all  stages  and  then  checking  whether 
the  (now  certain)  terminal  benefits  from  the  project  should  be  realized. 
The  expected  net  gain  from  such  a  policy  is  given  by 

V  =  E[z|z  >   0]  -  c  s  (55) 
where     Z  %  N(p,  k2c2Ys2Y) . 

Assume  that  p  =  vs.   Simple  manipulation  gives 

V  -  |kcYs(Y_1)  E  |w|w  >  ^^^ "1  +  6  ~  c  "Is        (56) 

where  W^N(0,1)  . 

Consider  y   <   1  first.   As  s  ->■  0,  we  have 

V  -v  kcY  E[x|x  1   0]  sY  >  0  (57) 

so  that,  whatever  the  value  of  v,  it  is  optimal  to  continue  when  s  is 
close  enough  to  zero,  i.e.  for  y   <   1: 


dU 
ds 


=  «  (58) 

s=0 


Next,  consider  y   >   1.   As  s  ->  <*>,  (57)  holds.   Thus,  whatever  the  value 
of  v,  it  is  optimal  to  continue  when  s  is  large  enough,  i.e.,  for  y   >   1: 


y(3) 


-oo  as  s  -»■  oo  •  (59) 


The  investigation  of  limits  in  the  other  direction  requires  a  different 
approach.   Although  it  can  be  established  rigorously,  let  it  be  assumed 
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that  y(s)/s  goes  to  a  limit  as  s  tends  to  zero  or  infinity.   When  y  <  1, 
y*  =  lim  y(s)/s  must  be  investigated.   It  is  already  known  that  y*  <  c".   It 

S->-co 

will  be  shown  that  if  {y  ,  s}  is  such  that  y  /s  =  v  where  y*  <   v  <  c"  then 

s  s 

V(vs,s)  must  be  negative  for  sufficiently  large  s.   This  contradicts 
optimality  and  so  it  must  be  the  case  that  y*  =  c". 

Only  the  general  argument  will  be  sketched.   Assume  that  y/s  =  v  where 
y*  <  v  <  c~.   If  s  is  sufficiently  large,  the  decision  rule  says  that  the 
project  should  be  continued.   We  can  ask  the  question:  should  the  project  be 

te1) 

continued  at  least  tsv   '  stages,  for  some  fixed  t  ?   It  is  not  difficult 
to  show  that  the  distribution  of  the  change  in  p,  6y,  over  this  time  period 
is  given  by 


>y  ^  N  (o,  2yk2c2Y  xs^  ^ J 


(60) 


Thus  the  change  in  y/s,  6 (y/s) ,  is  given  by 

6(y/s)  =  Z(2Yk2c-2YT)1/2  //^-D  .  ^(Y-D  (61) 


where  Z  ^  N(0,1).   With  y   <   1,  the  distribution  collapses  to  a  point  as 

s  -»-  °°.   Thus,  with  probability  approaching  unity,  y/s  will  not  reach  y*  and 

1+Y 
so  the  project  will  be  continued  for  at  least  xs   2   with  an  expected  net 

1+1 

running  cost  of  xcs 

Next  consider  the  expected  net  gain,  given  that  the  process  starts  at 


ft-) 

{vs  +  6y,  s  -  xs^   '}.   It  is  cl 


ear  that  the  expected  net  gain  cannot 
exceed  the  expected  net  gain  that  would  result  if  the  actual  path  of  y   is 
known  ab  initio.   If  the  future  is  known,  only  those  paths  which  lead  to  a 
benefit  which  exceeds  running  costs  will  be  followed.   Expected  net  gain 
will  be  given  by 
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e[w|  W  >  cs  ]  -  c  s    Pr{W  >  c  s}  (62) 


0+Y) 

where  WvN(vs  +  6u»  k^c2 '  sz ' )  and   s  =  s  -  ts^      .   Manipulation  of  this 


expression  yields,  when  s  -*■  °°, 


<   k  cYsY 


°       VZTT 


We  can  now  state  that  V(vs,  s)  cannot  exceed  V  after  the  payment  of  a 

TCS\  z  /. 


running  cost  with  expected  value  xcs^  l    I .   Using  (63) , 

-  TCS^' 


k  CYSY 


V(vs,s)  £  —7= —  -  tcsv  z  '  (64) 

/2T7 


when  s  ■>  <*>.      Thus,  as   s  ->■  <», 


V(vs,  s)  <  sY 


fkcY      -Ml  n 

-    TCSV  Z     '      \         <  0 

_/2tt  J 


(65) 


This  is  the  contradiction  that  we  wished  to  obtain:   it  must  be  the 
case  that 

y(s)/s  ■*■  c     as  s  -*•  °°.  (66) 

A  similar  analysis  applies  when  y   >  1  and  s  ->  0,  i.e.,  for  y  >  1, 

=  c  (67) 


du_ 
ds 


s  =  0 


These  limiting  properties  give  a  good  indication  of  the  general  shape 

of  the  optimal  stopping  curve  y(s).   Figures  4  and  5  show  the  two  cases 

Y  <  1  and  y   >   1.   (Actual  numerical  simulations  are  for  7  =  h   and  y   =  2; 
axes  are  scaled  so  that  when  o  =C  ,  values  of  s,  o  ,  and  C  are  all  normalized  to 
These  general  shapes  are  intuitively  plausible.   For  Instance,  if  y  >  1 

and  s  is  large,  the  completion  of  more  stages  of  development  significantly 

reduces  the  variance  of  terminal  benefits  at  little  cost.   It  is  not 
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<^ 


-3?- 


F\<*.  5  (^=o) 
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surprising  that  in  this  case  a  very  weak  decision  rule  is  applied  at  first. 

The  results  for  y  >   1   are  in  accord  with  those  derived  for  the 
homogeneous  SDP.   If  the  process  y   >   1  starts  at  s,  the  average  value  of 
a./C  ,  t  <  s  begins  at  zero  when  s  =  0  and  then  increases  monotonically  to 
infinity  at  s  =  °°.   The  analysis  of  the  homogeneous  SDP  suggests  that  for  the 
case  y  >  If  p(s)/s  should  begin  at  c  when  s  =  0  and  decrease  to  -°°  at  s  =  °°. 
Our  investigation  of  the  limits  of  the  non-homogeneous  process  y   >   1  show  that 
this  is  actually  true.   An  analogous  interpretation  would  show  that  results 
for  the  case  Y  <  1  are  also  in  accord  with  the  homogeneous  SDP . 

Finally,  we  have  so  far  been  maintaining  that  the  distribution  of 
terminal  benefits  shrinks  to  a  point  as  s  tends  to  zero.   However,  the 
analysis  is  in  no  way  affected  if  the  random  variable  of  terminal  benefits 
is  given  by 

X  =  X  +  R  (68) 

s    s 

where  X  and  R  are  independent  and  the  mean  of  R  is  zero.   The  uncertainty 
associated  with  R  is  uncertainty  that  cannot  be  reduced  by  research,  develop- 
ment or  exploration.   As  should  be  clear,  the  distribution  of  R  does  not 
alter  the  decision  rules  that  have  been  discussed,  the  effect  of  R  being 
eliminated  when  expected  values  are  taken. 

5.   The  Normality  Assumption  and  the  Theory  of  Information  Gathering 
Processes 
So  far,  the  assumption  that  the  distribution  of  benefits  is  normally 
distributed  has  been  rigidly  maintained.   The  purpose  of  this  section  is  to 
consider  under  what  conditions  normality  follows,  which  requires  a  slightly 
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more  general  study  of  information  gathering  processes. 

Abandoning  the  axiom  of  normality,  we  shall  retain  the  assumption  that 

the  SDP  is  a  continuous  process.   Rather  than  presuming  that  the  relationship 

between  a     and  C  is  of  a  particular  form,  assumption  2c  will  be  invoked, 

i.e.  a  =  h(C  )  where  h  is  some  well-defined  continuously  differentiable, 

monotonically  increasing  function  with  0  =  h(0).   Normalizing  s  so  that 

C  =  sc",  2c  implies  that  a      is  a  well-defined  function  of  s,  which  means  that 
s  s 

the  expected  cost  of  uncertainty  reduction  at  stage  t  is  known  at  stage 

s,  s  >  t.   This  is  a  powerful  restriction  because,  along  with  an  assumption 

of  the  form  that  small  amounts  of  information  can  only  change  beliefs  by  a 

small  amount,  it  will  imply  the  normality  postulate. 

Let  r  be  the  information  that  has  accrued  by  the  time  that  the  SDP 
s 

reaches  stage  s.   In  general,  a  decision  maker's  distribution  of  terminal 
benefits  at  stage  s  will  depend  upon  r  .   Let  this  distribution  function  be 

f  (xlr  ).   Between  stages  s  and  t,  s  >  t,  further  information,    r  ,  will  be 

s   '  s  st 

received  and,  at  stage  s,  there  will  be  a  probability  measure  on   r  ,  call 

it  H,  which  may  depend  upon  accumulated  information  r  .   The  following 

s 

relationship  will  hold: 

f  (x|r  )  =   /  f^(x]r  )  dH(r  ).  (69) 

S     S       t-    t     t       s 
srt 

Define 

y  (r  )  =  /  x  f  (xlr  )  dx  (70) 

s  s     x    s   '  s 

to  be  the  mean  of  the  distribution  of  terminal  benefits  as  viewed  at  stage  s. 

Since  at  stage  s,    r   is  unknown,  u. (r.)  will  be  a  random  variable.   Consider 

s  t  t  t 

Au(r  )   =  U<_(r.)  -  u  (r  )  (71) 

s       t  t     s  s 
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which  is   also  a   random  variable.      We  have 


E[Ay(r   )]   =        /      y.(r.)    dH(r   )    -   y    (r  )  (72) 

s  r.      t     t  s  s     s 

s   t 


Making  use  of  (69)  and  (70) 


e[  Ay(r  )]  =  0  (73) 

s 


Given  this,  the  variance  is 


Var[Ap(r  )]  =   /   (y  (r  )  -  U^(rJ)2  dH(r  ) 
s       r    s   s     t  t        s 
s  t 


(74) 


Now,  we  know  that 


/  (x  -  y  (r  ))z  f  (x  r  )  dx  =  a  z  (75) 

v       s   s     s   '  s  s 


for  all   s   and  r  .   Using  (75) ,  manipulation  of  (74)  yields 

Var  [  Ay(r  )]  =  a  2  -   a  2  (76) 

s       s     t 

which,  by  assumption  (2c) ,  is  independent  of  r  . 

The  remarkable  feature  of  (73)  and  (76)  is  that  the  first  two  moments 

of  the  distribution  of  the  difference  between  expected  terminal  benefits  at 

two  future  stages  in  the  SDP  are  independent  of  information  that  is  received 

during  the  course  of  undertaking  the  SDP  previous  to  the  two  stages. 

The  usefulness  of  Ay(r  )  is  that  y„(r_)  is,  as  h(0)  =  0,  the  terminal 

s  0   0 

benefit  that  may  be  received.   By  (71),  the  distribution  of  Ay (r  )  when 
t  =  0  gives  the  distribution  f  (x|r  ),  displaced  so  as  to  make  the  mean  zero. 
Let  us  now  assume  that  the  continuous  process  is  the  limit  of  a  discrete 
process.   As  earlier,  let  the  step  length  be  i.      The  incremental  change 
in  the  mean  of  terminal  benefits  is  given  by 


-36- 


6y  (r  )  =  p    (r   )  -  y  (r  )  (77) 

s  s     s-£  s-l  s  s 


If  I   is  small,  we  have  by  (73)  and  (76) , 


E[5y  (r  )]   =0  (78) 


s  s 


m 


Var[6ys(rj]      =  (  -j-2-  J  I  (79) 

We  also  have 

s_ 

% 

y  (r  )  -  u    (r  )   =   E   Sy  „(r  .)  (80) 

o  o     s  s      T=1   x£  x£ 

We  may  note  immediately  that  if  &\i      is  independent  of  r  then,  by  the 

Central  Limit  Theorem,  y  (r  ) ,  and  hence  F  ,  will  be  normally  distributed 

o  o  s 

if  I  +  0. 

However,  this  is  a  Markovian  assumption  and  we  are  more  interested  in 

the  possibility  that  y   could  be  a  non-Markovian  process .   For  many  such 

processes,  it  may  be  reasonable  to  assume  that  small  amounts  of  information 

can  only  change  beliefs  by  a  small  amount.   As  Sy  captures  a  change  in  beliefs 

and  E[(6y  (r  ))21  =  0(5,),  a  reasonable  restriction  is  that  third  and  hiqher 
s  s 

moments  of  6y  (r  )  contract  to  zero  faster  than  0(£) . 
s  s 

E[(6y  (r  ))n]  =  o(£),   n  =  3,4,5,  ...  (81) 

s  s 

Let  g(y,t)  be  the  probability  density  function  of  y   at  stage  t  given 

that  y  =  y*  at  some  s  >  t.   We  have 
s 

g(y,t)  =  E[g(y  -  "Sy^,  t  +  I)],  (82) 

where  the  expectation  is  taken  over  6\i.      With  the  minimal  assumption  that  g 
has  bounded  derivatives,  a  Taylor  expansion  of  (82)  gives  the  result  that, 
as  I   -»-  o  (making  use  of  (78),  (79)  and  (81)): 
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1   d°t2 

*t  +  1    at~  *w  -  °  <83> 

This  is  the  well-known  'heat  equation1  which,  under  the  boundary  condition 

imposed,  gives  rise  to  the  normal  distribution.   Thus  \i    (r  )  must  be  normally 

distributed  when  viewed  at  stage  s,  and,  in  consequence,  the  distribution 

functions  f  (xlr  )  must  all  be  normally  distributed.   We  have  therefore  shown 
s   '  s 

that  the  normality  postulate  follows  from  an  assumption  of  the  form  that 
small  amounts  of  information  only  change  beliefs  by  a  small  amount,  along 
with  the  assumption  that  a   depends  just  on  the  stage  of  development. 

Finally,  we  may  briefly  mention  SDPs  where  beliefs  can  undergo  a  radical 

change.   This  occurs  when  continuous  research,  say,  leads  to  a  sudden 

7 
breakthrough.    For  instance,  during  a  stage  of  length  £,  p  may  make  jumps 

which  are  independent  of  I   but  with  a  probability  proportional  to  I.      The 

first  two  moments  of  6y  will  still  conform  with  (78)  and  (79) ,  but  (81)  will 

no  longer  be  satisfied.   In  this  case,   f  (xlr  )  will  be  given  by  a  Poisson- 

s   '  s 

like  distribution  which  will  only  approach  normality  as  s  becomes  large.   In 
general,  of  course,  SDPs  can  embody  both  continuous  and  discrete  changes  in 
beliefs  but  an  investigation  of  discrete  processes  is  beyond  the  scope  of 
this  paper. 


6.   The  Two-Sided  SDP 

We  have,  so  far,  analyzed  a  process  where  all  stages  of  development  must 
be  completed  before  benefits  are  received.   In  that  model,  research  and/or 
development  plays  the  double  role  of  moving  the  process  closer  to  the  stage 
where  terminal  benefits  are  received,  and  providing  information  concerning 
the  value  of  terminal  benefits. 

The  purpose  of  this  section  is  to  briefly  consider  the  Two-Sided  SDP, 
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where  only  the  second  role  exists.   That  is,  the  completion  of  development 
stages  provides  information  concerning  the  value  of  terminal  benefits  but, 
at  any  stage,  it  is  possible  to  move  directly  to  the  completion  of  the 
process.   Thus  a  dual  decision  is  faced  at  each  stage:   the  development 
process  can  be  terminated  or  continued;  given  termination,  either  the 
project  which  provides  the  terminal  benefits  may  be  undertaken  or  it  can 
be  discarded. 

An  example  of  a  Two-Sided  SDP  is  a  firm  considering  marketing  a  new 
product  when  consumer  reaction  is  uncertain.   At  any  moment  the  firm  could 
decide  to  market  the  product,  or  not  to  market  it  at  all;  or,  the  firm  might, 
at  a  cost,  perform  further  product  testing,  conduct  market  surveys,  and  the 
like. 

Many  irreversible  decisions  in  natural  resources  or  environmental 
management  can  be  viewed  as  Two-Sided  SDPs.    Examples  could  be  drawn  from 
several  other  areas.   Choosing  one  of  two  alternative  uncertain  projects 
can  frequently  be  modeled  as  a  Two-Sided  SDP. 

In  this  section  we  retain  the  assumptions  of  the  homogeneous  SDP 
(continuity,  normality,  proportionality  of  a     and  C  ) .   Equation  (29)  still 
applies  so  that  the  state  valuation  function,  V,  may  be  written  in  the  form 

V(p,s)  E   ug(u/s)  (30) 

There  will  now  exist  two  stopping  curves.   It  is  clear  that  there  must  exist 
a  u(s)  such  that  if  p  £  y(s)  then  the  process  should  be  terminated  and  the 
final  project  should  not  be  undertaken.   Similarly,  there  must  exist  a 
y(s)  (jj(s)  -  u(s)  Vs)  such  that  if  \i   -   p(s)  the  process  should  be  terminated 
and  the  final  project  should  be  undertaken.   From  the  homogeneity 
assumption,  these  stopping  curves  will  be  linear,  i.e., 
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y(s)   =  3s 

%  (84) 

y(s)  =  cs 


where  C,   ^  3.   Such  a  configuration  is  shown  in  Figure  6.   The  reason  for 
adopting  the  Two-Sided  SDP  terminology  is  now  clear. 

Equations  (12')  and  (27')  apply  as  earlier  and  the  differential  equation 

(25')  continues  to  hold  when  \i      lies  between  y  (s)  and  u(s).   We  must 

s 

investigate  the  form  of  V  at  the  stopping  line  y(s).   If  the  development 
process  realizes  a  point  {y,s}  where  \i   ^  y(s)  then  the  terminal  benefits  will 
be  taken  directly.   By  definition,  the  expected  reward  associated  with  such 
an  enterprise  is  given  by  y,  i.e., 

V(y,s)  =   y,   y  >   y(s)  (85) 


Applying  this  result  in  (24)  gives 

V  (y(s),s)  =  1  .  (86) 

As  V  =  g  +  (y/s)g',  (85)  and  (86)  become 

g(C)   =   1  (87) 

and       g'  (?)  =  0  .   (88) 

g' (x)  is  given  by  (33)  so  that  (27')  and  (88)  yield 

-  -^—  I  =  k  exp|  -  -£— \  (89) 

Thus,  |&|  =  |?|.   However,  asg(3)^g(C)->3^Cr?-6   implies  that 

5  >  0  (90) 

and       3  =  -C-8  (91) 
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Thus  the  stopping  lines  must  be  symmetrical  about  the  horizontal  axis 
in  Figure  6.   To  characterize  the  slope  parameters,  we  may  note  that 

1  =  g(c)  -  g(B)   =   /  g'  (x)  dx,  (92) 

so  that,  pursuing  a  similar  analysis  to  that  in  section  3,  we  obtain 


[Pr{Z  >  C,} 
1  -  2Pr{Z  >  i 


c=  e[z|z  >  ?]  >  ?} 


(93) 


where  Z  ^  INKOjO2)  - 

Performing  comparative  statics,  ?  goes  up  when  a"  increases  or  when  c 
decreases.   As  a   tends  to  zero,  or  as  c  tends  to  infinity,  C,   tends  to  zero. 
As  o~  tends  to  infinity,  or  c  tends  to  zero,  ^  tends  to  infinity. 

As  might  have  been  suspected,  the  symmetrical  feature  noted  in  (91)  is 
a  general  result  for  Two-Sided  SDPs.  Figure  7  gives  the  basic  shape  of  the 
stopping  curves  for  the  cases  studied  earlier  where  a     =  k(C  )  . 

Note  that  p  can  be  interpreted  as  the  difference  between  the  means  of 
the  distributions  of  benefits  associated  with  two  projects,  one  of  which 
must  be  chosen.   Interpreting  p  as  p   -  p ,  "termination  and  discontinuation" 
means  selecting  project  1,  "termination  and  undertaking"  means  selecting 
project  2.   In  this  context,  running  costs  will  be  costs  expended  to  both 
evaluate  and  discriminate  between  the  two  projects,  as  well  as  the  implicit 
cost  of  delaying  both  projects  for  a  period. 

As  an  example,  it  may  have  been  decided  that  an  electricity  generating 
station  is  to  be  built  and  the  decision  is  whether  it  should  be  coal  or 
nuclear  powered.   The  Two-Sided  SDP  may  be  used  to  derive  rules  which  tell  a 
planner  that  either  more  research  into  the  net  benefits  associated  with  the 
two  options  should  be  undertaken,  or  one  of  the  plant  designs  should  be 
adopted.   From  our  analysis  it  may  be  noted  that,  independent  of  research 
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costs,  in  an  optimal  policy  more  information  should  be  sought  if  both  options 
seem  to  offer  the  same  expected  benefits,  given  any  uncertainty. 

It  may  be  remarked  that  the  Two-Sided  SDP  is  indicative  of  the  way  in 
which  the  results  and  methodology  of  earlier  sections  can  be  extended  to  cover 
other  related  situations. 

7.   Concluding  Remarks 

This  paper  has  examined  optimal  sequential  decision  rules  for  research, 
development  and  exploration  projects.   Instead  of  summarizing  the  analysis, 
we  will,  in  concluding,  simply  note  the  fact  that  a  natural  taxonomy  of 
processes  has  been  uncovered. 

First,  we  have  seen  that  it  is  important  to  distinguish  between  those 
processes  for  which  the  stages  of  development  must  be  completed  before 
benefits  can  be  received  and  those  where  development  stages  are  optional. 
Most  real-world  processes  contain  stages  belonging  to  both  categories  although 
sometimes  the  dichotomy  is  clear  cut,  e.g.  market  research  contains  only 
optional  stages. 

Second,  the  analysis  of  section  5  suggests  that  it  is  useful  to 
distinguish  between  processes  where  small  amounts  of  information  only  change 
beliefs  by  small  amounts  and  processes  where  there  are  sudden  breakthroughs 
or  setbacks.   The  form  of  the  distribution  functions  which  capture 
uncertainty  of  terminal  benefits  depends  crucially  upon  this  feature  of 
the  development  process. 

Finally,  it  has  been  shown  that  there  is  a  qualitative  difference  between 
those  processes  for  which  it  is  the  case  that  remaining  running  costs  fall 
faster  than  the  standard  deviation  of  terminal  benefits  and  those  processes 
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for  which  it  is  the  case  that  remaining  running  costs  fall  slower  than  the 
standard  deviation  of  terminal  benefits. 

Our  hope  is  that  a  categorization  of  real-world  processes  along  these 
lines,  perhaps  accompanied  by  some  crude  calculations  based  on  the  formulae 
of  this  paper,  will  provide  a  helpful  start  toward  understanding  the 
rational  application  of  funding  criteria. 
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Footnotes 

1.  As  will  be  made  clear  later,  it  is  easy  to  cope  with  a  situation  where 
there  is  residual  uncertainty  that  cannot  be  removed  by  research. 

2.  As  we  are  restricting  ourselves  to  the  family  of  normal  distributions, 
the  variance  is  an  unambiguous  measure  of  the  degree  of  uncertainty. 

3.  For  instance,  although  Klein  (1962)  has  suggested  that  the  standard 
deviation  falls  faster  than  expected  costs  to  completion,  Scherer  (1962)  , 
in  a  comment  on  that  paper,  suggested  that  the  reverse  proposition  is 
likely  in  many  instances.   Assumption  2a  is  a  natural  compromise. 

4.  A  continuity  argument  may  be  used  to  show  that  the  decision  maker  will 
be  indifferent  about  continuing  if  y  =  u(s). 

5.  This  also  requires  the  continuity  of  u(s)  which  can  be  proved 
rigorously  without  difficulty. 

6.  With  a  different  decision  criterion,  sunk  costs  could  influence  optimal 
behavior.   For  instance,  this  would  be  the  case  if  the  objective 
function  was  expected  utility  and  the  utility  function  embodied  a 
non-constant  degree  of  absolute  risk  aversion. 

7.  An  apt  terminology  might  be  the  Eureka-SDP. 

8.  It  is  possible  for  V  to  be  well-defined  if  B  =  C  =  0-   In  this  case,  the 
derivative  of  g  is  not  well-defined  and  our  analysis  is  not  applicable. 
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